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These notes are based on a collective discussion that started with Alessan- 
dra Bianchi in December 2007 at the WIAS in Berlin and went on during the 
next two months in Rome 2 and 3 with Tony Iovanella, Francesco Manzo, 
Francesca Nardi, Koli Ndreca, Enzo Olivieri, Betta and Benedetto Scoppola, 
Alessio Troiani and Massimiliano Viale. Since all of us were working on ar- 
guments more or less strongly related to metastability, we all felt the need 
to understand in some or more depth the links between potential theory and 
Markov processes on which are based the tools coming from the former that 
Bovier, Eckoff, Gayrard and Klein introduced in the study of metastability [22] 
and were successfully applied in [24], [25], [28], [34], [35] among other papers. 
Many mathematicians and physicists are certainly well aware of these links but, 
at various degrees, it was not our case and we thought that a good understand- 
ing of this connection was an essential support to intuition and a precious guide 
in the use of these tools. As J.L. Doob once put it: "To learn potential the- 
ory from probability is like learning algebraic geometry without geometry. " [4] 
This explains why before going to the specific application to metastability I will 
essentially focus on potential theory and Markov processes for themselves. 

Still because concerned by the leading ideas founding the connections be- 
tween potential theory and Markov processes I will write complete proofs only 
in the simplest context that allows for avoiding any technicality and makes more 
transparent these connections: that of Markov chains on a finite state space X 
(and this does not exclude working in the regime where the cardinality \X\ goes 
to infinity). We will not however restrict our analysis to this simpler setting. 
Potential theory begun indeed in a quite different form during the last three 
decades of the XVIII century with the works of Lagrange and Laplace that 
described the gravitational field as deriving from a potential V solution of the 
Laplace equation 

AV = (0.1) 

and blossomed in the first half of the XIX century as the cornerstone of electro- 
static, in particular with Gauss and Green's works. This development was so 
important that the study of harmonic functions, that is of the solutions of the 
Laplace equation, used to be one of the main pillar of the accademic formation 
of any physicist or mathematician at the end of the century. 
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The study of Markov processes started with Markov at the beginning of 
the next century but, as far as I know, it was not before the last years of 
the second world war that the links with potential theory begun to be drawn 
by Kakutani [2J. It took then almost 40 years to make this connection fully 
developed. In 1984 Doob published his treaty Classical Potential Theory and 
its Probabilistic Counterpart and in the same year Doyle and Snell wrote their 
beautiful article |6J that embraced in a same light the mathematics of random 
walks and the physics of electrical networks. Since then people did not stop 
harvesting the fruits of such a fertile union. See for example: [3J, [TS], [2B], [3D], 

mi- urn. 

A final motivation for writing these notes is that we could not find (although 
it probably exists) a single synthetic text that linked together the electrostatic 
of original potential theory, the physics of electric networks and the probabilistic 
meaning of the objects they contemplate. But I want to point out a few classics 
that I found particularly useful to write these notes, even though some are 
not mainly or directly linked to the subject: together with Doyle and Snell's 
article [SJ there were Norris' book [20], Lyons and Peres' continuously updated 
online book [17], Karatzas and Shreve's book [ID) . Sinclair's paper [14], and 
Lawler's book [11] . I want also to thank here Pietro Caputo and Alessandra 
Faggionato for the many discussions we had that considerably enriched these 
notes. 

1 Laplace equation 
1.1 Harmonic functions 

In this section and the next one IA will denote an open subset of the d-dimensio- 
nal vector space R d . For x in M. d we will write x-y, X2, ■ ■ ■ , Xd for its coordinates 
and we will use the notation P>2(x,r) for the open Euclidean ball of centre x 
and radius r > 0. 

Definition 1.1.1 For f € C 2 (U,M.) we define the Laplacian of f as 




and we say that f is harmonic on IA when it satisfies the Laplace equation on IA 

VxeU,A x f = (1.2) 

Examples: With 

r:(x 1 ,...,x d )eR d ^^x 2 + ... + x 2 (1.3) 
a harmonic function on R d \ {0} is r if d = 1, Inr if d = 2 and r 2 ~ d if d > 3. 



2 



The previous definition is a good one in the measure in which it frames harmonic 
functions inside differential calculus with all the tools it provides. But this 
definition looks to harmonic functions from an essentially local point of view. It 
has to be reformulated to make transparent larger scale properties of harmonic 
functions. 

For / £ C 1 ^,!!) we will denote by V/ or V/ or grad/ its gradient 

grad/ i^MhVJ- (P-i*)) e Rd ( L4 ) 

\OXk J i< k < d 

For <j> £ C 1 (U,"R (i ) we will denote by div0 or V</> its divergence 

V0 : x £ hi h-> div^ := V ^-(x) £ M (1.5) 

Hence, saying that / is harmonic on hi is saying that 

div(gradj) = (1.6) 

or, equivalently, that V/ is a null divergence field. Now Stokes' lemma makes 
possible to switch from the local point of view to a larger scale one. 

Lemma [Stokes] Let cf> £ C X (W,R ) and V be an open subset of hi with a 
compact closure V C U and such that dV is a (smooth) submanifold of M. d . 
Then 



4>.dS := / (f).rida= / div^dA (1-7) 
dv Jdv Jv 

where ft is the unitary vector that is orthogonal to dV and oriented from V 

towards U\ V , while a and A stand for the surface and volume Lebesgue measure 

respectively. 

Stokes' lemma is a straightforward identity in its discrete version (see Sec- 
tion 12. 2p and we just assume it in its continuous one. It implies that for a 
harmonic function / on U and such a closed oriented smooth surface dV C hi 
the flux of the vector field V/ through dV is zero. And as a first consequence 
we get: 

Proposition 1.1.2 (Mean- value property) // / is harmonic on hi then f 
satisfies the mean- value property (m.v.p.), that is: 

Vr > 0, Vx e U, B 2 (x,r) C U f{x) = / / g (1.8) 

JdB 2 (x,r) \oB 2 {x,r))\ 

where \dB2(x, r)\ denotes the surface area of dB2{x,r), in such a way that the 
integral computes the mean value of f on dB2(x,r). 



Proof: We pick x in hi and define, for all r > such that B 2 {x, r) C 

/ d ° = [ 

3 2 (x.r) \dB 2 (x,r)\ 7as 2 (o,i 



.'/('■>:=/ f TzJ?: m = / fix + r^da^u) (1.9) 
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with <7i the uniform probability measure on 9i?2(0, 1). By continuity of /, 

limo(r) = /(x) (1.10) 

Then, we just need to show that g is constant, i.e., has a null derivative. Fix r 
small enough to have g(r) that is well defined. For all small enough real h and 
u £ 9i?2(0, 1), the Taylor formula gives 

Of f h d 2 f 

f(x+(r+h)u) = f{x + ru) + h^-{x + ru) + (h-t)-±(x+(r+t)h)dt (1.11) 

au Jq ou z 

so that, integrating over 9^(0,1) and using / £ C 2 (U) to control the second 
derivative in the integral, 

9{r + h)=g(r)+ J 1 f Vf.dS + o(h) (1.12) 

\dB 2 {x,r)\ J dB2 (x,r) 

By Stokes' lemma the integral in this sum is zero and we conclude g'{r) = 0. 

□ 

Actually the mean- value property characterizes harmonic functions and gives 
additional information on their regularity: 

Proposition 1.1.3 If f £ CiU) has the m.v.p. then 

i) f£C^{U); 

ii) f is harmonic on hi. 

Proof: The proof of i) is based on a simple convolution argument that can be 
find in [10] page 242. Now, if / is not harmonic, then we can find x G U and 
ro > such that divV/ is strictly positive (or strictly negative) on B2(x, ro) C 
ti. Then the derivation of the previous proof shows, with Stokes' lemma, that 
the function g defined in (|1.9|) is strictly monotone in the neighbourhood of 0. 
And this contradicts the m.v.p. □ 

The m.v.p. leads also to the following 

Proposition 1.1.4 (Maximum principle) If f is harmonic on U then, for 
all compact sets K C IA such that f can be extended by continuity on K, f\x 
reaches its maximum (and its minimum) on dK. 

Proof: Set M := max. f(K). If dK and f\j({M} were disjoint sets then we 
could find x in df\Zr{M} and r > such that B2{x,r) C K f\U. The m.v.p 
would give 

M = f(x)=[ f d ° (1.13) 

JdB 2 (x,r) \dB 2 {x,r)\ 

while the continuity of / in some y £ (dB2(x,r)) \ f\^f{M} would give 

/ f Tmrr m < M (i- 1 ^) 

JdB 2 (x,r) \oB 2 {x,r)\ 
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what would be a contradiction. 



□ 



The maximum principle is sometimes reported in the electrostatic context 
as: "The potential has no local extremum where there is no charge. " Indeed 
Gauss' law in Maxwell's equations reads 

divE = — (1.15) 

where p stands for the charge density, eo is the electric constant and E is the 
electric field that derives from a potential V, that is 

E=-VV (1.16) 

A "local extremum where there is no charge" would be an isolated local ex- 
tremum somewhere in the interior U of p _1 {0}, where the potential V is har- 
monic by (|1.15|) and (|1.16p . And that would be in contradiction with the max- 
imum principle. 

The maximum principle opens the door to uniqueness properties of the so- 
lution of the Dirichlet problem. 

Definition 1.1.5 (Dirichlet problem) Given g G C(dU,M.) we say that f is 
a solution of the Dirichlet problem on U with boundary condition g if f in C 2 (U) 
and C(U) satisfies the Laplace equation on U and coincides with g on dU. 

Examples: i) Consider a compact thermal conductor K, fix to g(x) the tem- 
perature in each point x of dK and assume that g is continuous on dK. If the 
temperature reaches an equilibrium f{x) in each point of the interior U of the 
conductor, then / will be solution of the Dirichlet problem on U with boundary 
condition g. Let us assume the existence of such an equilibrium temperature. 
The maximum principle gives us the uniqueness of the equilibrium temperature. 
Indeed if f\ and fi are both solutions, then f\ ~ f2 is solution of the Dirichlet 
problem with zero boundary condition. Then, on U, f\ — fi cannot take values 
larger than the maximum value on the border, that is 0, or smaller that the 
minimum value on the border, once again: f\ and f% coincide both on 14 
and dU. 

ii) Consider a finite number of (disjoint) compact electric conductors A\, . . . , A n 
and fix at values V\ , . . . , V n on these conductors the difference of potential with 
infinity. There cannot be any charge outside the conductors, so that, by (|1.15|) . 
(|1.16|) and taking the convention that the potential is at infinity, a potential 
V has to be solution of the Dirichlet problem on the complementary of U n A n 
with boundary condition Vk on dAk for k in {1; . . . ; n} and with the additional 
condition 

lim V{x) = (1.17) 

x — >oo 

Once again the maximum principle gives the uniqueness of the potential V under 
an existence hypothesis. 

Proving the existence of a solution of a Dirichlet problem turns out to be 
a rather difficult task when one stay inside the framework of plain functional 
analysis. It is time to turn to Markov processes. 
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1.2 Brownian motion 



For simplicity we will now assume that W is a bounded open domain. For 
extensions and generalizations to unbounded domains of the results presented 
here we refer to [TU] section 4.2. We denote by P x the law of a d-dimensional 
Brownian motion W starting from x £ M. d and by ta the hitting time of any 
set A: 

t a = inf {t > : W{t) e A} (1.18) 



Katunani's idea [5] was to present the candidate 

h:xeU^E x [g(W(T du ))} 



(1.19) 



to solution of the Dirichlet problem on U with boundary condition g. Since U 
is a compact set we have, for all x in hi, 



P x (rm < +oo) = 1 



(1.20) 



so that h is well defined. We clearly have h\eu — 9 and h has the m.v.p. Indeed, 
for any x € U and r > such that B2(x, r) C U, we have, by the strong Markov 
property at time TQB 2 ( x . r ) an d using radial symmetry: 



h(x) = E x [g(W(T du ))} 



E r. 



(1.21) 
(1.22) 



g(W(T 9U )) W(T d B 2 (x,r)) 

E v [g (W(t su ))] dP x (W(r aB2{x>r) ) = y) (1.23) 
da(y) 



yEdB 2 (x,r) 

dB 2 {x,r) ky \dB 2 (x,r)\ 



(1.24) 



As a consequence h is harmonic on U and the only point to check to get a 
solution of the Dirichlet problem is the continuity of h on U. This question is 
intimately linked to the notion of regularity. 



Definition 1.2.1 For any set A we define 

t+ := inf {t > : W(t) e A} 
and we say that U has a regular border when 

Va S dU, P a (r+ c = 0) = 1 



(1.25) 



(1.26) 



Proposition 1.2.2 A bounded open domain U has a regular border if and only 
if, for all g in C(dU) the function h defined in \1.19}) is continuous on U,i.e., is 
solution of the associated Dirichlet problem. 

We refer to [10] for the proof (of a stronger result). We give now some 
examples. 
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In dimension two and for b > a > consider the Dirichlet problem on 



U = B 2 (0,b)\B 2 (0,a) (1.27) 

with boundary conditions 1 on dB 2 (0, a) and on dB 2 (0, b). 
On the one hand, since lnr is harmonic, we have the solution 

f = rr = r L d^) 

in o — in a 

By the maximum principle / is the unique solution (U is a compact set). 

On the other hand hi has a regular border. Indeed a Brownian motion that 
starts from x in dlA crosses dhi infinitely many times during any time interval 
[0; t] with t > 0. As a consequence the function h defined in (|1.19p is solution 
of the problem and coincides with /. That reads 

Vz el 2 , a < r(x) <b^P x (T dB ^ a) < t 9B2(oM ) = ^"^^ (1-29) 

Consider now the Dirichlet problem on the punctured ball 

U = B 2 (0,b)\{0} (1.30) 

This example will have some relevance later when dealing with metastability in 
large volume (Section [f£4]). Sending a to in (|1.29[) we get 



Vx € B 2 (0, b) \ {0}, P x (r {0} < r aB2(0ib) ) = (1.31) 

This implies that the function h defined in (|1.19|) is equal to 2-{o}- It is not 
continuous and is not regular, as it could directly be seen from (|1.3ip . Such 
examples of domain with a non regular border can be built with a connected 
border in dimension d > 3. 

In the last example our candidate to solution for our problem on the punc- 
tured ball lost the election. But could have we find another solution? The 
answer is no: using the uniqueness of an eventual solution / and the radial 
symmetry of the problem we can show that / would be a simple function of r, 
then solving the Laplace equation in polar coordinates we would get 

/ = a + /31nr (1.32) 

with a and (3 constants, the continuity in would imply (3 — and the boundary 
conditions could not be conciliated. More generally: 

Proposition 1.2.3 If the Dirichlet problem on a bounded open domain U with 
boundary condition g has a solution f , then f coincides with h defined in H1.19\) . 

Proof: For all positive integer n we define 

U n := lx e U : d 2 {x,dU) > -\ (1.33) 
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Note that U n has a regular border since for all a in dU n a is on the border of a 
ball (of radius 1/n) contained in U^. We also define 

h n (x):xeU^E x [f{W(T U .))] (1.34) 

The functions / and h n coincide on U^, and they coincide on U n too: since 
U n has a regular border, both are solution of the Dirichlet problem on U n with 
boundary condition f\du„> since U n is a compact set, this solution is unique 
by the maximum principle. Now / is bounded as continuous function on the 
compact set U, and by dominated convergence we get, for all x in W, 

fix) = lim hn(x) = h(x) (1.35) 

n— >+oo 

□ 

The probabilistic approach to potential theory does not only solve some of 
the problems regarding the existence of a potential. It also laid the ground to 
receive deep insight from potential theory into Markov processes theory. For 
example formula (|1.29p gives the recurrence of the two-dimensional Brownian 
motion: send b to infinity to get 

Vx & B 2 (0,a), P x {t 9bm < +co) = 1 (1.36) 

The same potential study in dimension d > 3 gives 

Vx e K d , a < r(x) < b => P x {r dB2 ^ a) < r dB2(oM ) = r ^_ d _~J_ d (1.37) 

and the transience of the Brownian motion: 

Vx?B 2 (0,a), P x (T dB2(0 , a) < +oo) = (^) 2 d < 1 (1.38) 

We close this section with a last illustration of the evocative power of Kaku- 
tani's solution. Consider a single electric compact conductor K at potential 1 
in R 3 . By the so-called "point-effect" the electric field will be stronger in the 
neighbourhood of the points a of the convex parts of K with strong curvature. 
Indeed 

E=-VV (1.39) 
and Kakutani's solution for the potential V outside K gives 

V(x) = P x {tk < +oo) (1.40) 

(take the increasing limit of the solution of the Dirichlet problem on ^(0, R)\K 
with potential on dB2(0,R) when R goes to infinity.) Loosely speaking (we 
will give a stronger justification of the point-effect in Section (|4.1[) ) the escape 
probability can decrease much faster in the neighbourhood of such points a. 
And this why lightning rods are rods: a stronger field in the neighbourhood of 
the rod makes easier to reach the disruptive field there before than somewhere 
else. 
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1.3 Discrete Laplacian and simple random walks 

Going from R d to Z rf we loose the differential tool: derivatives have to be re- 
placed by their discrete version. Denoting by £ the symmetric subset of Z d x Z d 
made of the nearest neighbour sites 

£:={e = (e_, e+) G (Z d ) 2 : di(e_, e+) = 1} (1.41) 

the gradient of a real valued function / on Z d becomes an antisymmetric real 
valued function on £: 

V/:ee£M V e / := f(e+) - /(e_) G R (1.42) 

and the divergence of such an antisymmetric function cj> on £ turns to be a real 
valued function on Z d : 

divcf) : x G Z^ i — ► &iv x (f> := 0(e) G R (1.43) 

e_ —x 

The discrete Laplacian of / is then defined by 

A/:xGZ d ^ A a / := div x (V/) = ]T (/(f) ~ /(*)) ( L44 ) 

di(x,j/)=l 

Note that this is coherent with second order Taylor developments: for / in 
C 2 (R d ) and a unitary vector u 

d 2 f ( , .. /(x + /m) + /(^M-2/(*) . . 

ft? (s) = S W (L45) 

For IA <z1t d the border of W is 

dU := {e = (e_,e+) G £ : e_£«,e + ^} (1.46) 
and its external border is 

<9+W := {e+ G Z d : Be = (e_,e+) G dU) (1.47) 
A function / defined onMU <9+W is harmonic on W if 

VieW, Ax/ = (1.48) 
Observe that ()1.48|) expresses a local mean- value property: it is equivalent to 



Vx G U, —Axf 



\ di(x,y)=l J 
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The set of harmonic functions on Z d is the kernel of the generator of the (con- 
tinuous time) simple random walk, 53A, just like the set of harmonic functions 
on M. d was the kernel of the generator of Brownian motion, |A. 

Like in the continuous case the mean-value property of harmonic functions 
gives a maximum principle (for which the notion of compactness is replaced by 
that of finiteness), and this maximum principle can be used to show uniqueness 
properties for the solutions of Dirichlet problems. Given U C Z d and g a real 
valued function on its external border, we say that / is a solution of the Dirichlet 
problem on U with boundary condition g if / is harmonic on U and / coincides 
with g on d+U. Just like we used Brownian motion to prove the existence of a 
solution for some Dirichlet problem, we can do the same with simple random 
walks on Z d . For example: 

Proposition 1.3.1 For any finite subset U of7L d and any real valued function g 
on d+U, there is a unique solution of the Dirichlet problem on IA with boundary 
condition g. This solution is the function h defined by 

VxeUUd+U, h{x) := E x [g (CM)] (1-50) 

where E x stands for the expectation under the law of a simple random walk £ 
that start from x. 

Proof: By the Markov property, h satisfies the local mean- value property on U. 
Since h and g coincide on d + U, h is solution of the Dirichlet problem. It is the 
only one by application of the maximum principle. □ 



2 Electrical networks 

2.1 Random walks and generators 

An electrical network is a connected undirected weighted graph with positive 
weights, with no more than one edge between any pair of vertices and with 
finite total weight on each vertex. More formally it is a pair (X, c) with X a 
countable set and c a real valued non-negative symmetric function on X x X 
such that 

Vx € X, [i(x) := J2 ye x c(x,y) < +00 (2.1) 

and such that, for all distinct x and y in X, there exist x = z\, Z2, ■ ■ ■ , z n = y 
in X with 

Vfte{l;...;n-1}, c(z k ,z k+1 )>0 (2.2) 

We call nodes the elements of X, we say that two nodes x and y are connected 
when c(x,y) > and we call edges the elements of £, defined as the set of 
ordered pairs of connected nodes: 

£ := {{x, y) e X x X : c{x, y) > 0} (2.3) 
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Of course the edges in E do have a direction, but it is better to keep in mind 
the image of an undirected graph for which each pair of connected nodes can 
have two representatives in the symmetric subset E of X x X . The conductance 
between two nodes x and y is c(x, y) and the resistance between x and y is 

r(x,y) := e]0;+oo] (2.4) 

c(x,y) 

Note that and +00 are possible values for c(x,y) and r(x,y): when (x,y) is 
not in £ . 

We call potential any real valued function on X. If wc impose a potential g(x) 
on each node x outside a subset hi oi X 1 an equilibrium potential V associated 
with the constraint 

Vx 6 U\ V(x) = g(x) (2.5) 

has to satisfy Ohm's and Kirchoff's laws. 
Ohm's law: The current i associated with V is 

t:(x,y)<E£^t(x,y)= V{x) - Viy) (2.6) 

r{x,y) 



Kirchoff's law: For all x in U 



E i(*>v)=0 (2.7) 



In other words 

with, for any potential /, 



Vrr, e -£ x y = (2.8) 



£/:xe*~£ x /:=E^^ (/(</) -/(*)) (2.9) 
vex MW 

The operator £ is the generator of £, discrete time random walk on the network 
with transition probabilities 

p{x lV )= C ^- x,yeX (2.10) 

(we call generator of a Markov chain the generator of the associated continuous 
time Markov process that updates its position at each ring of a Poissonian clock 
of intensity 1 according to the transition probabilities of the Markov chain) 
and (|2.8|) expresses once again a local mean-value property (that is also a mar- 
tingale property for the process /(£) stopped in U c ). As a consequence one can 
deal with the question of existence and uniqueness of an equilibrium potential 
associated with U and g by using the maximum principle that follows from the 
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m.v.p. and using Kakutani's solution. For example if X is finite there exists a 
unique equilibrium potential 

V{x)=E x [g{^Tuc))], xeX (2.11) 



Remarks: i) The Markov chain £ we associated with (X, c) is ergodic and 
reversible with respect to the measure \x. Conversely, any reversible ergodic 
Markov chain £ on X is the random walk associated with some electrical network 
on ^. If fi is a reversible measure and p(., .) gives the transition probabilities 
of £ we just define c through (|2.10p to build a network for which the transition 
probabilities of the associated random walk are given by p(., .). 
ii) With each network (X, c) are associated a unique random walk £ and, for 
each U C X, a unique set Hu of harmonic functions on U, that is of solutions 
of (|2.8p ~ (|2.9p . But an ergodic reversible random walk £ is associated with more 
than one network since its associated reversible measure is defined up to a 
multiplicative constant only. These different networks correspond to different 
choices of the conductance unity. Of course when £ is associated with a finite 
reversible measure there is a canonical choice for the conductance unity: that 
for which \i is a probability. 

A given family of sets of harmonic functions TLu is associated with many more 
networks. Indeed, from an electrical point of view the diagonal values c(x, x) of 
a network (X, c) are irrelevant (note that self-loops are possible according to our 
definitions). Two electrical networks that differ only in these diagonal values 
give rise to the same sets of harmonic potentials TCu, but they are associated 
with quite different random walks that do not have the same reversible measures. 



2.2 Flows and currents 

For any e = (x, y) G £ and any potential / we will use the notation 

e_ = x (2.12) 

e+ = y (2.13) 

-e = (y,x) (2.14) 

V e / = M-f(x) (2.15) 

A path 7 is a finite or infinite sequence of edges e 1 , e 2 , ... such that, for all e k 
and e k+1 in 7 it is 

e h + =e k _ +1 (2.16) 
A cycle 7 is a finite path e 1 , . . . , e n such that 

el = e l _ (2.17) 

We call flow any antisymmetric real valued function on E. The current i = — cV/ 
associated, by Ohm's law, with any potential / is a flow. But not all the flows 
derive from a potential. It is easy to see that a flow (f> derives from a potential 
if and only if it satisfies the 



12 



Second Kirchoff 's law: For all cycle 7 

X>( e ) = ° ( 2 - 18 ) 

In this case the associated potential is uniquely defined up to an additive con- 
stant. 

The divergence of any flow is defined by 

div0 : x £ X ^ div x := £ 0(e) e M (2.19) 

e_ —x 

The border of any U C X is 

9W:={ee£: e_€W,e + ^W} (2.20) 

and we have 

Lemma [Stokes] : For any flow <fi and any finite K C X 

£ 0(e) = £ div K (2.21) 



Proof: 



£ div K = £ £ ^(e) (2.22) 



xEK xEK e-=x 



£ 0(e) + £ 0(e) (2.23) 



eed-Ff egdK 
e-EK e_eK 



We call S the last sum. It is also equal to 

£ 0(e) = £ -0(-e) (2.24) 

-e^SAT -egdK 
(-e)-eK (-e)_£K 

so that 

S=-5 = (2.25) 

□ 

This gives us another characterization of harmonic potentials f onU <Z X . 
These are the potentials for which the associated current is a null divergence 
flow on U (satisfies the first Kirchoff 's law) or, by Stokes Lemma, has zero flux 
through any finite cut-set dK for which K <ZlA. 

We close this section with a few definitions. For A, B disjoint subsets of X 
we say that is a flow from A to B when 

Ma E A, div a > (2.26) 
Vfe e B, div fc < (2.27) 
VxgAuB, div x cj) = (2.28) 
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Any flow is a flow from some A to some B. If A and B are minimal for this 
property, we call sources the elements of A and sinks those of B. The strength 
of a flow 4> with sources in A and sinks in B is 

\4>\ := max j ^ div a ; - ^ div b I (2.29) 

A unitary flow is a flow of strength 1. If <p is a unitary flow from A to i? and <Y 
is finite then, by Stokes' lemma with K = X, 

a£A beB 

If <f> is a unitary flow from A to B and £? is empty, then we say that is a 
unitary flow from A to infinity. 



2.3 Equilibrium potential between disjoint subsets 

Consider A and B subsets of X that satisfy 

A n B = and Vx e X, P x (t AuB < +oo) = 1 (2.31) 

with P the law of the random walk £ associated with the network. Assuming 
that A and B are disjoint subsets of X, condition (|2.3ip certainly holds when £ 
is recurrent, or 

U := X\(AUB) (2.32) 

is finite. 

Fix the potential at Va on i and Vb on B. Condition (|2.31[) ensures that 
Kakutani's solution of the Dirichlct problem on U with such boundary conditions 
is well defined. It turns to be 

V : x € X h-> V a P x (t a < tb) + V b P x (t b < t a ) (2.33) 

This is the only one bounded solution of the Dirichlet problem. Indeed, writing X 
as the union of an increasing sequence of finite sets K n we can define, for any 
bounded solution / and all x € X 



f n (x) := E x [f[Z{T AU BuKz))\ (2.34) 

The function / and /„ coincide on K^, A and B. Since both are solutions of a 
same Dirichlet problem on the finite set U n K n , they coincide on the whole X. 
Now, by dominated convergence, we have 

/= lim f n = V (2.35) 

n — >+oo 

As a consequence we will refer to V as the equilibrium potential conditioned 
to V A on A and Vb on B. In the special case V A — 1 and Vb — we will denote 
it by V A ,b- 

V A , B :xeX^ P x (t a < t b ) (2.36) 
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The current associated with V is (Ohm's law) 

i = -cVV = -(V A - V B )cWV A , B (2.37) 

its divergence is zero outside AU B (Kirchoff's law), while for a in A we have 

div a i = -fi{a)C a V (2.38) 

= (V A - V B )v(a)(-£ a V AtB ) (2.39) 

= (V A - V B )fi(a) P(°> y)[ P a( T A < T B ) - Py(TA < T B )\ (2.40) 

= {V A -V B ) l i{a)Y J P(a,v)[l-P y {TA<T B )] (2.41) 

= {V A -V B ) i i{a)Y J P(a,v)Py(TA>T B ) (2.42) 

yax 

= (V A -V B Ma)P a (r+>r+) (2.43) 
with, for any S C X, 

t+ := min{n > : £(n) G S} (2.44) 
The same computation gives for any b in B 

div b z = {V B -V A )n(b)P b {T+>T+) (2.45) 
By reversibility we have 

J>(a)P a (T+>r+) (2.46) 

a£A beB ri>0 

= EEE^(^ + >r A = »,£(«) = <*) (2-48) 



aeA 6GB ri>0 

= 5>(6)A(r+ > r+) (2.49) 

As a consequence i is a flow of strength 
\i\ = \V A -V B \Y J Ka)P a (rX > r+) = \V A - V B \ E M&)A(r+ > r+) (2.50) 

a£A 6eB 

We call capacity of the pair (A, £?) and denote by CU,b the strength of the 
current associated with Va.b 

Ca,b := E M«)^(t+ > r+) = M&)A(r+ > r+) (2.51) 

aSA beB 
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Assuming that Ca.b is finite, for example when A or B are finite, 

iA,B ■= — ^ (2.52) 

is a unitary flow from A to B. 

Writing X as the union of an increasing sequence of finite set K n , replacing A 
by A n = Af~)K n , B by B n — K c n and sending n to infinity we get an extension of 
these notions that turns to be useful when dealing, for example, with recurrence 
and transience problems (Section [5]). When n goes to infinity V Ant B n increases 
to the limit 

h A := P(t a < +00) (2.53) 
Ca„,b„ decreases to a non- negative limit, called capacity of A 

C A := Ka)Pa(r+ = +00) (2.54) 
and, if C A S]0; +oo[, then i A ,B converges to a unitary flow <p A from A to infinity. 



3 Energy dissipated in a finite network 
3.1 Conductance and potentials 

The energy dissipated per time unit in a finite or infinite electrical network 
(X, c) by a potential /, or its associated current i, is 

Hf) := \Y, r ^ 2 ^) 

x.yeX 

The factor 1/2 is here to ensure that each pair of connected distinct nodes 
is counted just once. T>(.) is the quadratic form associated with the bilinear 
Dirichlet form T>(.,.). As sum of non-negative numbers, D{f) is always well 
defined, even though not always finite. But the same will not be true for some 
of the sums we will write. To ensure the validity of our next calculations we 
will assume in this section and the next one that X is finite. 

If a an b under potential 1 and are two single points of an electrical network 
made of these two points only, the energy dissipated in the network under this 
potential would be 

c(a,6)(l -0) 2 =c(a,b) (3.3) 

This suggests: 

Definition 3.1.1 (Effective conductance) If A and B are two disjoint sub- 
sets of a finite network X , the effective conductance between A and B is 

C{A,B):=V{V a ,b) (3.4) 

(Va,b defined in \2.36\) ). 
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If X were restricted to the simple disjoint union AU B each edge of the 
cutset dA = —dB would feel a difference of potential equal to 1 and together 
they would carry a flow of strength Ca,b- As a consequence we would have 

C(A,B)=V(Va,b) = C a ,b (3.5) 

This is a general fact: 

Proposition 3.1.2 Capacity and effective conductance coincide. 

Proof: Recalling that the current i associated with Va,b is Ca.b-^a.b and that 
ia,b is a unitary flow from A to B, we have: 



C(A,B) = \Y,<*>vWa,b{x)-VaM? (3-6) 

= ±Y,i(x,y)\y AtB {x)-V A , B (v)] (3-7) 
= C A ,B^iA : B(x,y)V A , B (x) (3.8) 



= C a ,b^2Va,b{x) div x i A , B (3.9) 

X l on A, on AuB 
on B 

= C A ,B^2^Vx(iA, B ) (3.10) 
xeA 

= C A , B (3.11) 

□ 

Effective conductance satisfies a variational principle: 
Proposition 3.1.3 (Dirichlet's principle) 

C(A,B)= mm {©(/): /U = 1,/| B = 0} (3.12) 
and this minimum is reached in Va,b only. 

Proof: Any potential / that is equal to 1 on A and on B can be written in 
the form 

f = V + h (3.13) 

with 

V = V a ,b, h\ A = 0, h\ B = (3.14) 

Now 

V(f) = V(V + h) = V{V) + V(h) + 2D(V, h) (3.15) 
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and, denoting by i the current associated with V, 

V ^ h ) = 5X)c(»,y)[7(a;)-ni/)][^)-%)] (3-16) 

x,y 

= \Y,^y)Hx)-h{y)] (3.17) 

= ^2%{x,y)h(x) (3.18) 

= ^ h(x)div x i (3.19) 

X 

Since h equals on A U B and i has a null divergence outside AUBwe get 

V(f) = V(V) + V(h) > D(V) (3.20) 

as soon as h ^ 0. □ 
From Dirichlet's principle one gets immediately: 

Proposition 3.1.4 (Rayleigh's monotonicity law) If c\ < C2 are such that 
[X , ci) and (X^c-i) are two finite electrical networks, then, for any A and B 
disjoint subsets of X , C\{A,B) < C2{A,B), with obvious notation. 

We postpone to sections El [7] examples and applications. 
3.2 Resistance and flows 

The energy dissipated per time unit in a finite or infinite electrical network 
(X, c) by a flow 4> is 

V(<P):=\j2 r ^ 2 ( e ) ( 3 - 21 ) 

If cj> is the current associated with some potential /, we have, of course, 

V{cj>) = V(f) (3.22) 

Not all the flows can be derived from a potential and (|3.21|) generalizes (|3.22l) . 

Consider now A and B two disjoint subsets of a finite network X . By the 
previous variational principle, any potential that is equal to 1 on A and on B 
gives an upper bound on C(A, B). We derive now a second variational principle 
for which any unitary flow from A to B will give a lower bound on C{A, B). 

Definition 3.2.1 (Effective resistance) If A and B are disjoint subsets of a 
finite network X , the effective resistance between A and B is 

R ^ B ^--cih) (3 - 23) 
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Effective resistance satisfies the following variational principle, cited from [T] 
by Doyle and Snell [6]: 

Proposition 3.2.2 (Thomson's principle) 

R(A, B) = min {V(4>) : cj> unitary flow from A to B] (3.24) 
and this minimum is reached in %a,b only. 

Proof: The unitary flow i — Ia,b is the current associated with the potential 

Va.b 



V 



By bilinearity of the Dirichlet form, 



C(A,B) 



Now, any unitary flow from A to B, cj>, can be written 

= i + 6 

with 5 a flow that satisfies 

a<EA 

div 6 5 = 

beB 

Vi^iU B, divj = 



so that 



2?0) = 



(3.25) 

(3.26) 

(3.27) 

(3.28) 

(3.29) 
(3.30) 





f 2?(<J) - 


f i^2r(e)i(e)<S(e) 


(3.31) 




f £>(<*) - 


(x,s,)e£ 


(3.32) 




f I>(<5) - 


f2 £ V{x)5(x,y) 

(x,y)€£ 


(3.33) 


= 


f £>(<*)- 


f 2^V(a:)div x <5 


(3.34) 


= 
> 


f I>(<5) - 
f V(S) 


f 2^ C(A-B) -1 div 5 


(3.35) 

(3.36) 
(3.37) 

□ 



as soon as S ^ 0. 

As a consequence, any unitary flow from A to B will give an upper bound 
on the resistance, that is a lower bound on the conductance. See sections [5j HI 
[7] for applications. 
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4 Condensers 



4.1 Capacity and charge 

Let us go back for a while to the continuum. A condenser can be modelized as 
a bounded connected open domain U in R 3 (the domain of the dielectric) that 
separates, and is bordered by, two conductors A and B, at potential Va and 
Vb ■ There cannot be any charge outside the conductors and we have 

E = -W (4.1) 

div£ = - (4.2) 
e 

Since V is constant on A and B the equations imply that there cannot be 
any volumic charge density. Physicists say that there can only be a superficial 
density of charge (on dA and dB) and using Gauss theorem on an infinitesimal 
volume around a in dA they conclude that the superficial density of charge in 
a is given by 

q a = e(E.n)(a) (4.3) 

where n is the unitary vector orthogonal to dA and directed towards U. The 
total charge on A is given by 

Qa = / q a da(a) (4.4) 

JdA 

and the same computation can be reproduced for B. Since potential is defined 
up to an additive constant we can replace Vb by and Va by Vb — Va, then by 
linearity of the Dirichlet problem we get that Qa depends linearly on Va — Vb , 
i.e., there is a constant C, that depends on A and B such that 

Qa = C(V A - V B ) (4.5) 

This constant is called capacity of the condenser. In addition the energy con- 
tained in the condenser is given by 

/ (V A - V B )q a da(a) + [ Q.q b da(b) = C(V A - V B f (4.6) 

JdA JdB 

In the context of our electrical network with A and B that satisfy (12.31|) 
under potential Va and Vb respectively, for which we know the equilibrium 
potential V 

V = Vb + (Va — V B )P. (ta < tb) (4.7) 
and the energy dissipated in the network per time unit 

V(V) =C(A,B)(V A -V B ) 2 (4.8) 
the previous considerations lead us: 
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i) to define the charge in any x S X by analogy with (|4.2p : 

:= div^i (4.9) 

with i the current associated with V. This is equal to outside A U B, 
and for o £ 4, 5 £ B we get 

g a = (Va - V B )fi(a)P a (T+ > r+) (4.10) 
q b = {V B -V A )n(b)P h {T+>T+) (4.11) 

We recover the "point-effect" : the higher the escape probability the higher 
the charge. 

ii) to identify, assuming that Va > Vb , the strength of the current i with the 
total charge in A 

Qa := £)(Va - V B )^a)P a { T + > t+) (4.12) 

aeA 

and to observe that the two notions of capacity like the two notions of 
energy (contained in the condenser and dissipated per unit time in the net- 
work), coincide in their probabilistic interpretation, when any dimensional 
consideration disappears. 



We close this section with the 

Definition 4.1.1 (Harmonic measure) Given A and B subset of X that sat- 
isfy i2.31\) and such that 

C a .b < +oo (4.13) 

the harmonic measure on A is the normalized charge density on A under the 
equilibrium potential Va.b (or V defined in J^.7| )j. This is the probability mea- 
sure va on A such that, for all x in A, 

"A(«) = ^fff>4) (4.14) 

E^wJ^W > t b) 



Ca,b 



(4.15) 



The harmonic measure can be obtained by conditioning the stationary mea- 
sure by A and the event "the process £ that start from the sampled point x in 
A stays outside A at all positive times before Tb" ■ This does not mean that the 
random walk that starts under va cannot visit A many times before reaching 
B. Indeed the conditioning is on the starting point only: it just means that va 
selects the points with the higher escape probability not that once chosen the 
starting point the escape will occur. However it is important to note that va is 
concentrated on the internal border of A. 
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4.2 The Green function 

(X, c) is an electrical network associated with the Markov chain £. 

Definition 4.2.1 (Green function) For any B C X we define the Green 
function 



G B : {x, y) G X 2 h-» E x 



TB-l 

n=0 



(4.16) 



GB{x,y) is the expected number of visits in y starting from a; and before 
hitting B. Using (I4.17|) and the reversibility of £ we have, for all x and y in A" 

n(x)G B (x > y) = G B (y,x)iJ,(y) (4.18) 

If ^4 and B subsets of X satisfy condition (|2.31[) then the Green function 
Gb is intimately linked to the potential P.(ja < tb)- To sec that we use the 
so-called last exit decomposition. We define 

La,b '■= sup {n > : f (n) G A and n < t b } (4.19) 

with the usual convention 

sup0 = -oo (4.20) 
and we have, for all x in X, using the Markov property and (14. 17ft : 

P x (ta<t b ) = P x (La,b>0) (4.21) 

n>0 



E E P * ^ = o, n < r B ) P a (r+ > r+) (4.23) 

n>0 a£A 

Y J G B (x,a)P a (r+>T+) (4.24) 



that is, by flTTgj) . 



p,(r A <r B ) = £ ^rr 1 mW^. W > 4) ( 4 - 25 ) 

a£A ^ y ' 

charge in a under Va,b 

In the electrostatic language we would have say that each charge q a creates the 
potential 
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Indeed, the previous calculation made in the special case A = {a} gives 



G B (a,.) 



P.(r a < Tb) 



MO) v(a)P a (t+ > t+) 



(4.27) 



so that V a is harmonic on B c \ {a} (satisfies the local m.v.p.). 

Assuming that Ca,b is finite, formula (14.25|) also gives much information 
on the random walk that starts under the harmonic measure va and stops in 
B. First, it links potential, capacity and stationary measure with the expected 
number of visits to any point x before t b . Multiplying by fi(x) and dividing by 
C(A, B) we get 



.tiKtb 



h(x)P x (t a < tb) 
Ca,b 



(4.28) 



Second, summing over all x outside B, we get the expected hitting time 
of B. This is the main formula that was introduced in [22] for the study of 
metastability: 



E„ 



[tb] = ^T"7 V( x ) P x( r A < T B ) 



x£B 



KVa,b) 
Car 



(4.29) 



Last, it makes possible to give the probabilistic interpretation of the unitary 
flow i A ,B- For e = (x, y) £ S we have 



U,s(e) 



c(x,y) 



Px(tA<T B ) Py(T A < T B ) 



= J2"A{a) 



a£A 



Ca,b Ca,b 
G(a,x) G(a,y) 



c{x,y) 



fi(x) n(y) 
E v A (a)(G(a,x)p(x,y) - G{a,y)p(y,x)^ 



E (lw-y(«»)>{(" + l)) 



.ti<tb 



(4.30) 
(4.31) 
(4.32) 

(4.33) 



This is the expected net flux of the walk through e. 



5 Application to transience and recurrence 
5.1 Recurrence and conductance 

Let £ be a reversible ergodic Markov chain on X, and (X 1 c) an associated 
electrical network. The random walk is recurrent if 

Vi, y e X, P x (r y < +oo) = 1 (5.1) 
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otherwise it is transient. If X is finite £ (that is assumed to be ergodic) is 
necessarily recurrent. In general we can write X as union of an increasing 
sequence of finite connected subsets K n , and we have 



Proposition 5.1.1 The following assertions are equivalent 
£ is recurrent 

3a G X, P a (r+ < +00) = 1 

3a e X, E a [E^o^M (£("))] - +^ 
3a 6 X, lim Gk c (a,, a) = +00 

n — > + oo n 

3a e X, lim C a ,K-;, = 

X 



1 
ii 

111 



3a 6 X, 3uq > 0, 3(f n ) 

f n (a) = 1, f n \ K 



[0;i], 



Proof: i) 



0, lim V(f n ) 

n — >+oo 



ii) is clear and ii) => i), since, for all x £ X, 
P a {r x < +00) > 



(5-2) 
(5.3) 

(5.4) 

(5.5) 

(5.6) 

(5.7) 
(5.8) 



and a random walk that almost surely visits a infinitely many times, will almost 
surely visit x. 

ii) iii) is clear and the number of visits in a for the random walk that 
starts in a is distributed like a geometric variable of parameter 



P 



= Pa(r+ = +00) 



(5.9) 



If p ^ the expected number of visits in a is finite and iii) => ii) follows. 

We have iii) <^ iv) by Beppo Levi's theorem, and iv) v) follows from (|4.28|) 
applied with A = {a} and B — K^. 

v)<=>vi) follows from a variational principle for effective conductances. It 
was proved (Proposition 13. for finite networks and we can extend it to our 
situation: for any n we build a finite network (X n , c n ) by collapsing in a single 
point b, all the nodes in K^: we define X n as the union of K n with a singleton 
{b} and we define c„ by 



if (x,y) = (b,b) 

c n (x, y) := { c(x, y) if (x, y) e K n x K n 

E yeK o c{x, y) if (x, y) e K n x {b} U {b} x K n 



(5.10) 



On the one hand the law of the random walks £„, associated with {X n ,c n ), 
and £ that start in a are the same up to tk^ ■ The total weight in a is the 
same in the two networks, hence the capacity C a ,K^ associated with (X, c), 
coincides with C a ,b- On the other hand C(a, b) satisfies the variational principle 
of Proposition 13. 1 .31 and the Dirichlet form of the corresponding test functions 
coincide with the Dirichlet form of the test functions of what would be the 
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analogous variational principle on X. This proves the validity of this variational 
principle and concludes the proof. □ 

Example: For the simple random walk on 1? the conductance of each edge is 
1/4. We set, for all n > 1, 

K n :=\-{n-l);n-l] 2 (5.11) 



and we consider the potentials 

In : — > [0;1] 



It^A. (5.12) 

o ifie^ 



We have 



2J(/ n ) = -s-i— £ (8 * 8)V1 [ln(fc + l)-lnfc] 2 (5.13) 
In (1 + n) ^ 4 

< y"2fci (5.14) 

- m 2 (l + rc)^ fc2 

< 2 1+ 2 lD( " + 1) (5.15) 

ln 2 (l + n) V ' 

and we conclude that the random walk is recurrent. 

This may not be the simplest proof of the recurrence, but it is the most 
resistant I know. For example if we remove any set of edges from the initial 
graph, then by Rayleigh's monotonicity law the random walk obtained by re- 
fusing the jump each time it tries to move along a removed edge is recurrent on 
each connected component of the obtained graph. 

5.2 Lyons' criterion 

We can add to our list of Proposition 15.1.11 a last criterion, due to T. Lyons 
(see [3]), for deciding whether a given random walk £ is recurrent or not. 

Proposition 5.2.1 A reversible Markov chain £ associated with an electrical 
network (X, c) is transient if and only if there is a unitary flow from some a in 
X to infinity that dissipates a finite energy in the network. 

Proof: If £ is transient then, for any a in X, 

lim C a , K c =C a >0 (5.16) 

n — >+oo 

In this case (i a ,K c )n>o converges to a unitary flow <f> a from a to infinity and we 
have 

V a ,Kc \ ,. C a ,K<= 1 

. <^ 

(5.17) 



T>((f> a ) = lim V(i aK c) = lim V \ ' " = lim 2 " = — < +oo 
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If there is a unitary flow (f> from a G X to infinity with 

V{4>) < +00 (5.18) 

then, for n large enough, <j> is also a unitary flow from a to any K% and, denoting 
by V n the Dirichlct form on the network (X n ,c n ) built by collapsing K% in a 
single point 6, by r n the associating resistances, and defining a unitary flow from 
a to & by 

r 4>{e) if e G £ n 2f„ x K n 

4>n{e) := I J2 w gjr S J/) if e = (1, 6) with z G if„ (5.19) 

I (x,y)e£ 

we have (using Jensen's inequality to get Q5.23p ): 

V(4>) = \Y.r{e)4> 2 {e) (5.20) 

e££ 

> \ E K<0^(e)+E E r(x,y)tf(x,y) (5.21) 



2 

ee£n-fs"„x_fs"„ x&Kn yeK c 

(x,y)e£ 

\ E ^ 2 (e)+E E C ^^(M) 2 ( 5 - 22 ) 

e££nJf„xK„ ieif„ 2/£-K"° 



> 5 E ^)^)+E^)(^) (5 - 23) 

= \ E Ke)^ 2 (e)+ E ^(1,6)^(1,6) (5.24) 

ee£nK n xK n xeK n 

= D n {<p n ) (5.25) 

> R(a,b) (5.26) 
= C- l K . (5.27) 

and we conclude that C a .K" decreases with n towards a strictly positive value. 

□ 

Example: Consider the simple random walk on Z d with d > 3. We can build 
a unitary flow </> from to infinity in the following way. First we associate with 
each 9 in 

S d - X : = aB 2 (0,l) (5.28) 

a path 7 from to infinity, e 1 , e 2 , . . . such that ( | [ e5_ 1 1 2) fe>o is increasing and, for 
all k > 0, the distance between e\ and the half line [0, 9) is less than 2. Second 
we define, for all e G £ 1 

/(e) := l 7 (e) - l 7 (-e) (5.29) 
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<f) e is a unitary flow from to infinity. Last we define 4>{e) as the expected value 
of (j> (e) when 9 is chosen according to the uniform probability measure P on 
S d ~h 

4>{e) :=P(e£7)-P(-eG7) (5.30) 
(j) is a unitary flow from to infinity, we have 

P(0 = 5>(e)0 2 (e) (5.31) 

r>l V y 



< +oo (5.34) 

and we get the transience of the random walk. 

Lyons' criterion for transience has proven to be extremely powerful. It has 
been used for example in [15] to prove the transience of the random walk on the 
infinite supercritical percolation cluster in dimension d > 3. 



6 Application to metastability 

6.1 Restricted ensemble 

Metastability is characterized by (at least) two different time scales, a short and 
a long one, and an apparent equilibrium. If the equilibrium of the system is 
described by a measure /z, this apparent equilibrium is described by a restricted 
ensemble [i-jii that is the equilibrium measure conditioned to a subset 1Z of the 
state space X. With a probability of order 1, the system initially described by a 
metastable equilibrium [x-ji will escape from 1Z on the long time scale, then, on 
the short time scale, will go far away from 1Z (far away in the sense that he will 
come back to 1Z on a third and still longer time scale) towards a more stable 
equilibrium. 

Such a behaviour can be modelized through that of an ergodic continuous 
time Markov process X on a finite state space X on which are defined an Hamil- 
tonian H and its associated Gibbs measure \i at inverse temperature (3 > 

H := -^exp{-{3H} with Z := V exp{-f3H{x)} (6.1) 

and for which X is reversible with respect to /i (so that /i is the unique equilib- 
rium measure) . The previous expressions "short and long time scales" , "proba- 
bility of order 1" make then sense in some asymptotic regime, for example when 
(3, \X\ or some other parameter of the dynamic goes to infinity. 
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In what follows we will consider continuous time Markov processes X defined 
by a Metropolis algorithm associated with H, i.e., with a generator of the form 

l x j : = J2 ex P {-P My) - H (x)}+} (f(v) - /(*)) (6-2) 

(note that (|6.2[) guarantees the reversibility with respect to fi) and we will 
consider the (by far easier) regime (3 — * +00, or a joint regime in which (3 and 
\X\ go to infinity. We will refer to these two kinds of regimes as finite and large 
volume dynamics respectively. 

6.2 Finite volume dynamics 

Our two main examples are Glauber and Local Kawasaki dynamics. Given A a 
finite square box in Z d with d > 2 the Glauber dynamics is defined on the state 
space 

X = {-l;+l} A (6.3) 
with Ising Hamiltonian with periodic boundary conditions 

H : o~ E X < ► — i Ja ^J ~ \ ^2 ha i ( 6 - 4 ) 

{i,i}cA 

where J > is the ferromagnetic interaction constant, /i > the magnetic field, 
and d±(i,j) gives the 1-distance on the torus between the projections of i and j. 
It is a single spin flip dynamic, that is y ~ a; in (|6.2p means that y is obtained 
from x = a G X by changing the value of <r in one site i of the torus. 
The Local Kawasaki dynamics is defined on the state space 

X = {0;1} A (6.5) 

with Hamiltonian 

H :r/E X ^ -UViVj + Ar]l ( 6 ' 6 ) 

{i,j}CA\d_A '£A 

where — U < is the binding energy and A > an activity parameter. It is a 
(locally conservative) nearest neighbours exchange dynamic with creation and 
annihilation of particles on the internal border of the box, that is y ~ x in (|6.2|) 
means that y is obtained from x — r\ G X by exchanging the value of 77 between 
two nearest neighbour sites i and j in A or by changing the value of r\ in one 
site % G d-A. 

Whatever the model we consider, the individuation of a set 1Z with the pre- 
viously described properties is part of the problem. For finite volume Glauber 
dynamics it was done by Neves and Schonmann in [H] , [T3] and this was gener- 
alized to a host of situation including that of the beautiful paper of Schonmann 
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and Shlosman [2T] that consider metastability for Glauber dynamics in infinite 
volume at finite temperature and in the regime h — > 0. For finite volume Local 
Kawasaki dynamics it was done by den Hollander, Olivieri and Scoppola in [33] 
for d — 2, by den Hollander, Nardi, Olivieri and Scoppola in cite [27J for d = 3. 
Assuming that 

and defining the critical length l c by 



[%n for Glauber dynamics 
for Kawasaki dynamics 



u 



2U-A 



(6.8) 



one can define a gate G, set of critical configurations at a same energy H(Q) 
that, for Glauber dynamics and d = 2, are the quasi-squares droplets of +1 in 
A \ cLA of dimensions (l c — 1) X l c with a protuberance attached on the long 
side, while, for Local Kawasaki dynamics, have for prototype the quasi-squares 
droplets of 1 of dimensions (l c — 1 ) x l c with a protuberance and an extra free 
particle. 



□ 



Figure 1: Critical configurations for Glauber and Local Kawasaki dynamics in 
the case l c = 5. 



Then it was shown (see in particular [31] for Local Kawasaki) that, with a G X 
the configuration made of —1 only (0 only) and b £ X the configuration made 
of +1 only (1 in A\cL_A and in 9_A) for Glauber (Local Kawasaki) dynamics, 
for A large enough: 

(PI) b is the only one fundamental state, that is the global minimum of the 
Hamiltonian, 
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(P2) a is the only one metastable state in the sense of that is, with 



r := min < H{a) V maxi/(e + ) : 7 is a path from a to b > — H(a) (6.9) 
there is, for all x in X \ {a}, 



r > min < H(x) V max H (e + ) : 7 is a path from x to b > — H(x) (6.10) 
^ ee 7 J 

(P3) Q has the gate property, i.e., any path that realizes the min-max (|6.9p 
has to cross Q and reaches its maximum in Q, so that, in particular, 

r = H(Q) - H(a) (6.11) 

(note that T depends on J and h or U and A only), 

(P4) if A and B are the two cycles in the sense of Wentzell and Freidlin [7] 
that are the connected components of a and b in H^i] — 00, H (Q)[) then 

Q C d+A (6.12) 

and, by (P2), 

\/x B, H(x) > H{a) (6.13) 

This is a big amount of information - (P2) includes a control of the global 
energy landscape - and at this point there are many possible choices for the 
set 1Z. Natural choices include 

• A, 

• the connected component of A in i? _1 (] — 00, H(Q)]) \ Q, 
. H-\]-^,H(G)])\B, 

• larger sets (including for example a small piece of B)... 

With any of these choices Wentzell-Freidlin theory leads, for all 5 > 0, to 



limsupilnP^ (r^,r b ? [e^; e™]) < 



(6.14) 



This does not say much about the existence of our "short time scale" but it is a 
strong indication that our "long time scale" should be e r/3 . It takes, indeed, for 
the system initially under [x-r., essentially the same (long) time to reach 1Z C and 
6, and when the system is in b it is "far from 1Z" : one can see, using reversibility, 
that, typically, the system needs at least a time of order 

e {H{G)~H(b))l3 = e (T+H(a)-H(b)-)f3 > g r/3 / g 

to go back to 1Z. 
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In addition, Wentzell Freidlin theory, leads also to 



r = lim -\nE^[mA (6-16) 

= lim hnE^ln] (6.17) 

P^+oc p 

= lim IlnS a [r K e] (6.18) 

p 

= lim -\nE a [n} (6.19) 



We refer to for the derivation of all these results on the basis of (PI)- 
(P4). 

Remarks: i) The pathwise approach on which were based the proofs of (Pl)- 
(P4) gives also the "short time scale". For example, in the case of the Local 
Kawasaki dynamics, it is of order e^ 2A ~ u ^ [31]. 

ii) Equations (|6.16[) - (|6.19p are stronger than (|6.14[) in the sense that the former 
imply (with Markov inequality) the upper bound on t-r and Tf, expressed by the 
latter, while the lower bound on these times is easy to get using reversibility. 
However it is important to note that (|6.16[) - (|6.19p imply in general an informa- 
tion (of the kind of (P2)) on the global energy landscape. If a does not lie on the 
bottom of the deepest well (like expressed in (P2)) and can reach, without going 
in 6, a well with a depth T' larger than T with a probability exponentially larger 
than e ~ (r '~ r)/3 then (|6TTC|) - (|6TTg|) cannot hold. By contrast, results like lj6~T2)) 
can be derived by a strictly pathwise approach (see for example 16 : on Glauber 
dynamics in dimension 3) without such kind of information on the global energy 
landscape. 

6.3 Beyond exponential asymptotics 

On the basis on (P1)-(P4), potential theory can improve (]6.16|) - (|6.19[) beyond 
exponential asymptotics. Bovier and Manzo did that in [25] and gave the exact 
asymptotics of E a [Tb] for Glauber dynamics. 

They did so applying (|4.29p to the sets {a} and {b}, and, this implied, in 
particular, giving some estimates on the capacity. As a far as the upper bounds 
(on the capacity) are concerned, they estimated C(a, b) with 

C{a,b) < C(A,B) (6.20) 

where A and B are the two cycles defined in (P4) (by Dirichlet's principle the 
conductance is increasing in its arguments). To give a lower bound on the 
capacity they drop some terms in the Dirichlct form of the variational principle 
(Rayleigh's monotonicity law) to get a linear network for which they were able 
to compute the capacity. This is equivalent to building a linear flow and using 
Thomson's principle. 

We will use a slightly different strategy: we will apply (|4.29|) directly to 
our cycles A and B. But before doing that we have to pass through a little 
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algebra to link the study of our continuous time Markov process X to that of 
the discrete time random walks £ we dealt with in the previous sections. 

Observe that the generator L defined in (|6.2p cannot be written in the form 
that £ assumed in (|2.9|) : given x £ X the sum on y ~ x of the rates 

X(x, y) := exp {-/3[JT(y) - JT(a;)] + } (6.21) 

is in general larger than one. But it is certainly smaller than 



N 




number of sites in A for Glauber 

number of bonds inside A \ <9_A and sites in d_A for Kawasaki 

(6.22) 

We define then the network {X , c) with, for all x and y in X ', 

if y 7^ x and y rfi x 

^ {x)x ^ x ' y) iiy^xandy^x (g.23) 



^c(z,y)=/i(z) (6.24) 

the random walk £ associated with (<Y, c) is reversible with respect to /i. Its 
generator is defined by 

£*f E ^fertf w - A*)) - E - /(*)) = ( 6 - 25 ) 

Recall that we called "generator of a discrete time Markov chain £" that of the 
continuous time process that updates its position at each ring of a Poissonian 
clock of intensity 1 according to the transition probabilities of £. Denoting by 
£ this continuous time process (|6.25[) means that £ is nothing but the rescaled 
process X: £ behaves like X except for the fact that it is N times slower. 
As a consequence 

E VA [t b {X)\ = ±E VA [t b (0] = ^E VA [tb(0] (6.26) 



and (|4~29]) gives 

E Va \t b {X)\ = * — ]T »{x)P*{ta < tb) (6.27) 

where we have to recall that the conductances that are involved in the compu- 
tation of C(A, B) are defined in (|6.23[) and depend on N too. 

By (I6.13[) the last sum in (|6.2T|) is equivalent to fi(a) and, in the case of the 
2-dimensional Glauber dynamics, it turns out that for all g in Q, A U {g} U B 
is a connected set, while for all distinct <?, g' in Q, g and g' are not connected. 
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These two properties make then the capacity in (|6.27p quite easy to estimate. 
Indeed, we first note that for all x ^ y with x ~ y, 

ti(x)X(x,y) exp{-/3(ff (a) V H(y))} 
c(x, y) = = — (6.28) 

This implies that, for any function / on X that takes its values in [0, 1], is equal 
to 1 on A and to on B, all the terms in the Dirichlet from D(f) that involve 
a node beyond the energy level H(Q) are exponentially smaller than D(f), and, 
using the gate property of Q and the fact that for all g in Q, A U {g} U B is a 
connected set, we conclude that the C(A, B) is equivalent to the capacity of the 
pair (A, B) in the network (AU^UB, c). In this network a fraction 2/l c of the 
nodes in Q have only one edge towards A and one edge towards B, while the 
other nodes have only one edge towards A and two edges towards B. 



V A = l 





"V" 



_J 



l\Q\ 



V B = 



Figure 2: The network (A U Q U B, c) 

All these edges have the same conductance 

_ exp{-/3ff(a)} 



NZ 



and we get 



C (A,B) ~ -< ^ ~ ^ - (2 ^ c ~ i^lexpi-/^)} 



III 

c c £ ' 2c 



3LNZ 



(6.29) 



(6.30) 
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We conclude, using (|6.11[) . 



and 



j? r f Y v 3l c Zfi(a) 3? c e r/3 

^ [Ts(x)] ~ (2i c -i)\g\eM-PH(g)} = (2i c -i)\g\ (6 ' 31) 

From this we get the same estimate on E a [Tb\. Here is the logic of the argu- 
ment. The probability va is concentrated on A that is a cycle of depth V. as 
a consequence the system will typically reach a in a time exponentially smaller 
than e r/3 before going to B. But B is a cycle with internal resistance smaller 
than r (a is the only one metastable state), hence, after reaching B the system 
will typically go to b in a time exponentially smaller than e r ^. This leads, for 
any small enough S > 0, to 

3/ p t < 3 

KM + o( e < r - f >») = £„„ MX)] ~ {2k °_ ij]gl (6-32) 

E ^ ~ 10W\ (6 ' 33) 

To put the argument properly you have to quantify the probability of "atyp- 
ical behaviours" to control the expectations, and this, knowing (P1)-(P4), is 
elementary classical Wentzell-Freidlin theory. 

With (|6.33p everything boils down to the computation of the number of 
critical configurations. For the 2-dimensional finite volume Glauber dynamics 
we find 

|S|=4Z C |A| (6.34) 

(there are |A| choices for the south-west corner of the quasi-square, 2 choices for 
its orientation and 2l c choices for the position of the protuberance). We refer 
to [25) for the study of the dynamics in higher dimension. 

For Local Kawasaki the situation is more complex: first Q (that is not 
uniquely defined) is not so simple, second the electrical network that connects 
A and B is "stretched" and much more intricate. But the same method can be 
applied, C(A, B) can be estimated via our two variational principles, and, once 
again, everything is reduced to some computation of \Q\. This is the difficult 
point of [34] that gives sharp asymptotics of E a [r^] for this model in dimensions 2 
and 3. 



6.4 Large volume dynamics 

Glauber and Kawasaki dynamics in large volume are defined as continuous time 
Markov chains X on the space X of the configurations made on -1 and +1 
(Glauber) or and 1 (Kawasaki) on the d-dimensional discrete torus of 
volume 

(A^l = e 013 (6.35) 
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(we round off large integers). They are defined by a Metropolis algorithm asso- 
ciated with the Hamiltonian 

H : a 6 X — - JoiOj — - ^2 ^ lGi (6.36) 

{i,j}CAg ieA 

for Glauber dynamics (y ~ x in (|6.2|) has the same signification as that of the 
finite volume dynamics), and 

H :r)eX^ J2 - u ViVj (6-37) 

{i,j}cAf3 
di(i,j)=l 

for Kawasaki dynamics (y ~ a: in (|6.2p now simply means that y is obtained 
from x = ij E X hy exchanging the value of rj between two nearest neighbour 
sites i and j in A^). We will assume 

6 < T (6.38) 

where T is the energy barrier defined in the local version of the dynamics. 

In large volume, we lose much of the tools inherited from Wentzell and 
Freidlin. Nevertheless many kind of restricted ensembles have been individuated 
for Glauber dynamics even in infinite volume or at fixed temperature f[18j. |21j). 
It is not so for conservative dynamics: as far as I know there are still only 
unpublished results ([39], [40]) that prove the desired properties of a set 1Z in 
large volume with d = 2. But with the tools of potential theory Bovier, den 
Hollander and Spitoni [37] computed sharp asymptotics on some hitting times 
that give very strong indication that the set 1Z defined as the set of configurations 
for which there are no more than l c (l c — 1) + 1 particles inside each square box 
of volume smaller than L 2 ^ with 

Lj := e (A -W with 5/3 = o(l) and i = 0(8/3) (6.39) 

can be associated with a metastable restricted ensemble. They also gave anal- 
ogous results for Glauber dynamics. I refer to [37] for precise statements. Here 
I just want to make a few comments on the method. 

The central idea is to apply (|4.29|) . We have then four main questions to 
deal with: 

Ql: How should we choose A and Bl 

Q2: How can we estimate the capacity Ca.b 1 - 

Q3: How can we estimate the mean potential /jl(Va,b)1 

Q4: How can we link the expectation starting from the harmonic measure E VA 
with the expectation starting from the restricted ensemble ? 
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The ideal choices for A and B would be A — {a} for any a in 1Z and B = 1Z C , 
then B in a sequence of sets that go far away from 1Z. If we were able to prove 
that for such choices E ua [t b ] has a divergent asymptotic (in exponential of 
(3) that does not depend on A and B, we would not have our "short time 
scale" but, since lower bounds on typical exit time are generally easy to get by 
reversibility, the problem would essentially be solved. In particular Q4 would 
have a trivial answer. But choosing for A a singleton {a} makes in general Q2 
and Q3 extremely difficult to answer. Indeed we always have, see (|2.5ip . 

C(a,B) < fi(a) (6.40) 

and C(a, B) turns out to be super-exponentially small. This would also imply 
a sharp control on fj,(V A ^ B ) that is extremely difficult to get: we are indeed 
on the discrete version of a continuous Dirichlet problem without solution on a 
bounded domain. In conclusion A has to be "big enough" . As far as the choice 
of B is concerned we remain for a while on our ideal choice. 

For a big enough A, Q2 is the easiest to answer: we can make use of our two 
variational principles. Actually Bovier, den Hollander and Spitoni made use of 
a more elaborated variational principle on the effective resistance that is due to 
Berman and Konsowa [8j. 

Q3 is in general more difficult to answer, since we do not have a variational 
principle on the potential. Sometimes, like in |22| . [2"5] . one can reduce an 
estimate on a potential to an estimate on capacities with the following 

Lemma 6.4.1 For all x outside of A and B, disjoint sets, it is 

P x {ta<t b )<^ (6.41) 

Proof: 

Px(jA <t b ) = P x {ta < t b |t+ > t AuB )P x (t+ > t AuB ) 

+ P x (t a < t b \t+ < t AuB )P x (t+ < t AuB ) (6.42) 

The first term in this sum is bounded from above by 

P x (r+ > t a \t+ > t AuB )P x (t+ > r AuB ) = P x {t+ > t a ) (6.43) 

while the second term is equal to 

P x {ta < t b )P x {t+ < t AuB ) = P x (t a < t b ){\ - P x {t+ > t AuB )) (6.44) 

Solving in P x {r A < t b ) we get 

PJTA < r B ) < ffli >TA \ < ^f^\ - %± (6.45) 

Px(T x > T AllB ) P X [T X > T B ) O^B 

□ 
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Unfortunately, single points in large volume have not enough mass for this to 
be useful (see above). Potential are difficult to estimate (in [39], [40] this kind 
of estimates involve a complex renormalization procedure) but we still have the 
trivial estimate 

V a ,b < S-so (6.46) 

On the model of our estimates of Section 16.31 what is needed is an estimate of 
the kind 

H(V A , B ) ~ (6-47) 

and this is given by (|6.46p only if B is not "too far" from 1Z. 

Denoting by A n the subset of 1Z such that there are no more than n < 
l c (l c — 1) + 1 particles inside each square box of volume smaller than L|, by n 
the smallest n for which 

M*(A0~1 ( 6 - 48 ) 

and, for all I > l c , by B n the subset of 1Z C of the configurations rj in X that 
contain (as subset of A^) a square of side length I, Bovier, den Hollander and 
Spitoni give the sharp asymptotic 

Vn e [n , lc(lc - 1) + 1], V/ 6 [l e , 2l c - 1], E VAn [r Bl ] ~ — ^ ^_ (6.49) 

Postponing the discussion on Q4, this essentially gives us our long time scale 
(beyond exponential asymptotics!) and the constraint I < 2l c — 1 is here just as 
a consequence of the difficulties that are encountered for estimating potentials. 
However, in the case of Glauber dynamics and as far as I understand, one 
could remove this constraint by an attractiveness argument that was used in 
the previous works in large volume and makes locally available the tools of 
Wentzell and Freidlin theory (just like we used it in Section 16.31 in alternative 
to Lemma f6 . 4 . 1 1) . 

One of the main strength of (|6.49j) is that it gives asymptotics that do not 
depend on n. One could have thought that the harmonic measure va being 
concentrated on the internal border of A would have introduced a bias. It is not 
so and the reason for this is probably the same that led us from the beginning 
to associate with 1Z the restricted ensemble /u-r. that is also the reversible and 
invariant measure for the dynamics restricted to TZ: for any "good" 1Z the system 
should typically relax in a short time scale to fx-n. Actually, Q4 raises a problem 
of convergence to (metastable) equilibrium. This is the object of the next and 
final section. 

7 Application to convergence to equilibrium 

7.1 Spectral gap 

For an extended covering of convergence to equilibrium we refer to [19j and [33] . 
Here we just indicate how the objects we discussed above link to the argument. 
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We recall that for £ Markov chain on a finite state space X with transition 
probability matrix M, £ is reversible with respect to the probability measure [i 
if and only if M is a self-adjoint operator on £ 2 (/J,)- In this case M has only real 
eigenvalues 

f = A > Ai > ... > Aat_i > -1 (7.1) 

and Aat_i > — 1 if and only if £ is aperiodic. In this case the rate of convergence 
to equilibrium in i 2 (n) is governed by 

A:=max{|Ai|;|Ajv_i|} (7.2) 

If A 7^ Ai then the transition matrix (M + 1)/2 of the associated lazy chain £' 
has only positive eigenvalues and a rate of convergence of the same order. We 
will then assume that £ itself is a reversible and ergodic Markov chain with a 
transition matrix M the eigenvalues of which are all positive. In this case the 
rate of convergence of £ in £ 2 (fJ,) is given by the spectral gap 

A:=l-Ai (7.3) 

that is the smallest non-zero eigenvalue of 

I — M = -C (7.4) 

or, equivalently, 

A := mm — — — — £ (7.5) 

fe(KerC)^- 

The numerator in this variational principle is 

(/,(-£)/>„ = ^2ti(x)f(x)(f(x)-J2pi^y)f(y)) (7-6) 

x \ V / 

= ^^fix^p&vKm-m) (7.7) 

x y 

= ^M^,»)(/W-/(l/)) J (7-8) 

= £>(/) (7-9) 

In addition, the kernel of £ is the one-dimensional subspace of £ 2 (/J,) that con- 
tains all the constant functions, and the orthogonal projection of any / on this 
subspace is the constant function fi(f). As a consequence one can extend the 
minimum in (|7.5p as a minimum on all the non-constant functions replacing / 

by / - Kf)> and tnis g ives 

A= min (7.10) 
Var(/)#o Var(/) 
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Any test function / gives an upper bound on the spectral gap. Restricting 
the minimum to characteristic functions we get 

A < min -^M^jL (7 . n) 

< 2 min C(A, f ) = 21 (7.12) 

where the isoperimetric constant I is defined by the last equation. 
Actually / gives also a lower bound on A: 

Lemma [Cheeger]: 

I 2 

— <\<2I (7.13) 

We refer to |19j for the proof where it is shown that a lower bound on / expresses 
an i 1 version of a Poincare inequality. A Poincare inequality is an inequality of 
the form 

V/ G £ 2 (n), Var(/) < nV(f) (7.14) 

and is equivalent to a lower bound on the spectral gap. 

If instead of restricting the minimum to characteristic function that are 
particular cases of equilibrium potential we restrict the minimum to general 
equilibrium potential Va,b, we get 

A < min S ( n B \ (7-15) 



< min °[ AB \ (7.16) 



AnB=H> Va,r(VA,B) 

. C(A,B) 
mm 

AnB=(D fi(A)n(B) 

Indeed, 

vax(y A ,B) = ^^T^^yWAA^-VAAy)] 2 (7.17) 
> \ E mOsMw) ( 7 - 18 ) 

x,y£AUB 

= KA)^B) (7.19) 

(7.20) 

In the metastable situation, when we have a, b, Q that satisfy (P1)-(P4) of 
Section RT2l this gives 

C(A,B) C(A,B) 1 1_ 

~ Im(A)h(B) fi(A) E va [t b \ E a [ n ] [ 1 

We prove in the next section that this is the correct asymptotics. 
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7.2 Lower bounds for the spectral gap 

We start with an easy estimate. Given / 6 £ 2 (/z) we have for any x and y in X, 
by bilinearity of T> and Dirichlct's principle, 

[f(x)-f(y)} 2 <R(x,y)D(f) (7.22) 

Multiplying by fj,(x)/i(y) and summing on all x and y we get a Poincare inequal- 
ity 

Var(/) <l[Yl l*(?Mv)R(x, V) J £>(/) (7-23) 

In the metastable situation with (P1)-(P4) one can estimate the effective 
resistance between x and y by building a linear (i.e., without ramifications) 
unitary flow from x to y with H(x) > -ff(y) to get 

n(x)n(y)R(x, y)=0 (fi(y)eP r '-y) (7.24) 

with the energy barrier between x and y defined by (|6.9p with a; and j/ in 
place of a and 6. Since 

fi(a)n(b)R(a, b) ~ M(o)iJ(o, 6) - E a [ n ] (7.25) 

is logarithmically equivalent to e r (3, we get, with (PI) and (P2), 

j<E a [n](l + o(l)) (7.26) 

and, together with (|7.21|) . 

\ ~ E a [n] (7.27) 

In [55] Bovier, Eckhoff, Gayrard and Klein prove such a relation for all the 
"low-lying eigenvalues" of the generator. In addition they prove that associated 
eigenvectors are equivalent to some equilibrium potentials. 

Better bounds. In many situations our previous Poincare inequality is however 
a bad one. This is because for different x and y the equality in (|7.22|) is in general 
realised by very different /. To improve this bound we modify the network in a 
specific way for each x and y. If we increase the conductance of the edges that 
are more charged by i x , y then we can decrease the resistance in (|7.22[) . After 
that we will have to reconstruct a Poincare inequality on the global network on 
the basis of these different inequalities in different networks. This may give good 
bounds if the currents in the different modified networks tend to use different 
edges. To put it formally, we associate with each (x,y) in X 2 a unitary flow 
4> x>y and a weight function 

w x>y '. e (E £ i — > w x ^ y (e) e [0; +oo[ (7.28) 

such that, for all e in £ , 

(<t>x, y (e) = 0) (w x , y (e) = 0) (7.29) 
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Interesting choices are 



(7.30) 
(7.31) 
(7.32) 
(7.33) 



Then we denote by T> x%y the Dirichlet form associated with the network ob- 
tained by replacing c with cw XiV and restriction to the connected component 
that contain both x and y. In particular we have 



W l,y 


: = 1 




W l;V 


:= \4 




w l-,y 


:= |r 


4>x,y\ 




:= rq 


x,y 



T3x,y(4>x,y) — y ] 



r(e) _> 



< H (e) 



(7.34) 



e:<^ a;iH (e)>0 

Now using both our variational principles we have 

\f(x)-f(y)\ 2 < 2V„(0x,„)2V„(/) ( 7 - 35 ) 
= V x , y (<fi X: y) 2J c ( e ) w x,y(e)\ - V e /| 2 (7.36) 

e:</>x, H ( e )>0 

Multiplying by fi(x)fi(y) and summing on all x and ?/ we get 

Var(/) < ^^(j,)!?,,,^) £ C (eK,,(e)|-V e /| 2 (7.37) 



0*,„(e)>O 



= ^X! c ( e )l ~ Ve ^' 2 X! f i ( x )^(y) w ^,y( e )' D x,y((f>x.,y) (7.38) 

0x, B ( e )>° 

< x max V" ^(x)iu,(y)w Xt y(e)T> xy (^ Xt y) (7.39) 

eGfc ^-^ ' 

This Poincare inequality gives 



x,y£X 
0x, H (e)>O 



Lemma 7.2.1 For any family of unitary flow <f> xy from x to y and i» I)9 that 
satisfies {7.28$ and \7.29\j we have 



- < max ^ n(x)n(y)w x , y (e)T> x , y (4> Xt y) 



(7.40) 



x ,yex 

<f>x, y {e)>0 



With w — w 1 we get 



T ^ m B- Yl Kx)^{y)'D{<i}x..y) 



(7.41) 



x,yeX 
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With w = w 2 and <f> x tV built as a family of linear flows that is 

<f> x . y {e) = ±y [XlV) (e) - a 7(X) j /) (-e) (7.42) 
with j(x, y) simple path from x to y we get 

x,y£X e'£j(x,y) 
e67(x,y) 

and this is Diaconis and Stroock's estimate [S]. 

With w = w 3 and ^ i3/ built like previously we get 

i<maxV n(x)ii{y)r(e)Yt(x,y)\ (7.44) 

A ee£ * — ' 

x,y€X 

that is one of Sinclair's estimates in [14) . while in the general case we get 

-<max V( x )V>(y)r(e)(/>x,y(e) ^ <^,y( e ') ( 7 - 45 ) 

</>x, y (e)>0 x , H (e')>O 

that is essentially equivalent to Sinclair's formula for "multicommodity flows" , 
actually strictly equivalent if 4> X:V is built (like usually it is) as a flow of geodesic 
paths. 

With w = w 4 we get 

J < max tixMvMe)<fe iy (e)\{e! G £ : cf> x<y (e') > o}| (7.46) 

0x, B ( e )>O 

Previous choices have proven their efficiency but at the time of sending these 
notes I did not have that of seriously checking the advantages of this last choice. 

7.3 Mixing time 

A stronger notion of convergence to equilibrium is that of the mixing time 

n :=inf it > : max||P^ -j"|| rv < - } (7.47) 

where 

\\P X - fi\\ TV := wax\P x (Z(t) GA)- fi(A)\ (7.48) 

is the total variation distance that, maximized over x, decays exponentially [35]. 
Since an exponential decay of the total variation distance implies an exponential 
decay at the same rate (at least) in i 2 (n), we have 

- ln(l — A) > — (7.49) 

Tl 
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In our metastable situation, since the equilibrium measure is essentially con- 
centrated on {&}, the study of the convergence to equilibrium should be essen- 
tially an hitting time problem. The coupling argument used in [32 , turns this 
intuition in a rigorous estimate of the mixing time. For any ergodic and aperi- 
odic Markov chain £ and any coupling (X, Y) with marginals following the law 
of £ we have, for all t > [3"3"] 

max \\P* - At|| TV < m ax P x , v {tc > t) (7.50) 

with 

t c := inf{< > : X{t) = Y(t)} (7.51) 

In our metastable situation, we can then obtain sharp estimates on the basis of 
the exponential law: 

Proposition 7.3.1 For a continuous time Markov chain built on a Metropolis 
algorithm at low temperature /3 _1 on a finite state space X and such that (Pl)- 
(P4-) hold, the random variables 

e 6 :=-^ and 9 B := (7.52) 
E[T b \ E[t b \ 

converge in law under P a towards an exponential random time of mean 1 as (3 
goes to infinity. 

This kind of result goes back at least to Cassandro, Galves, Olivieri and Vares' 
work [5] . The nice following proof is adapted from [29] . The argument works the 
same in much more general situation: as long as one can talk about metastable 
single states. 

Proof: We prove the result for 9 b : the same proof works for 9b- Since 

T>0^P a (T B >T) (7.53) 
is a non-increasing continuous function taht goes from 1 to 0, we can define 

T B := min |t > : P a (r B > T) = H (7.54) 
For all positive s we define also 

r* :~ inf ^t > sTb '■ X(t) G {a} U b\ (7.55) 

With 

R := e< f +W (7.56) 

where T is the internal resistance of B c , that is the maximal energy barrier under 
r between two states x in B c and y in B c U d+(B c ), and <5o > is such that 
r + Sq < r, we know, by classical Wentzell-Freidlin theory, that the probability 
of t* — sTb being larger than R is super exponentially small (SES), that is 

limsup - In P a (r* - sT B > R) = -oo (7.57) 
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For all positive t, if t b is larger than (s + t)T B then X will be outside B on the 
whole intervals 

I=[0,sT B ] and J = [t* A (s + t)T B , {s + t)T B ] (7.58) 

Since, up to a SES event, J is longer than tT B — R, 

P a (T B > (s + t)T B ) < P a (r B > sT B )P a (T B > tT B -R) + SES (7.59) 

If X stays outside B on 

I=[0,t*} and J = [t* , t* + tT B ] (7.60) 

then t b will be larger than (s + t)T B . Since, up to a SES event, / is shorter 
than tT B + R, 

Pa(r B > sT B + R)P a (r B > tT B ) - SES < P a (r B > (s + t)T B ) (7.61) 
By classical Wentzell-Freidlin theory we have also, for all 5 > 0, 

lim sup - In P a (r B < e (r ~ 5)/3 ) < (7.62) 

so that 

R - o{T B ) (7.63) 
and, by (|7.59p . for all large enough f3, 

Pa(r B >(s + t)T B ) < P a (r B > sT B )P a ( TB >(t- l)T B ) + SES (7.64) 

For all n = 2k, we get then, by induction on k > 2 and using (|7.54[) 

P a (r B > nT B ) < e-% p + nSES (7.65) 

and the tightness of (#/3)/3>o with 

h ■■= g (7-66) 

By Alaoglu's theorem and diagonal extraction there is a diverging sequence 
(Pk)k>o such that 6p k converges in law towards a random variable 8, for which, 
with (|7.59p . (|7.6ip and ()7.63|) . we have necessarily 

P (§ > s + tj =p(§>s S jp(§> t) (7.67) 

for all s and t outside A, set of 0's atoms. Since A is a countable set, so is QA 
and there is some x > such that 

xQnAc{0} (7.68) 
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By density of xQ and monotonicity of the repartition function we conclude that 
8 follows an exponential law. By (|7.54|) this can only be that of mean 1 and we 
get, for all t > 0, 

lim pAt b >tT B ) =e~* (7.69) 

— * + oo \ / 



0^ + 

In addition, by dominated convergence, 

7« + oo />+oo 


Now for t > and any e > we choose 7 > 1 such that 



lim E °£ B * = lim / P a {6 p > t)dt = I e^dt = 1 (7.70) 



e _t - e < -e~ 7 * < -ye~5 < e _i + e (7.71) 

7 



For /3 large enough we have, on the one hand 

tT B \ 



P a {0 B >t)<P a 1^t b > — < 7 e-" < e~ % + e (7.72) 
on the other hand 

> t) > P a (r B > ltT B ) > -e~^ > e- 1 - e (7.73) 

7 

and this concludes the proof. □ 

A simple analysis of the basic coupling, that is X coupled with an indepen- 
dent Markov chain Y with same generator, is then sufficient to give a sharp 
estimate of the mixing time. If X starts from x and Y starts from y, then in 
a time shorter than e^ T ^ s ^ , for a small enough 5 > 0, both will have typically 
reached AU B. If they have reached the same cycle they will also have met 
with a probability exponentially close to one (look at the dynamics as one built 
on a Metropolis algorithm on the product space X x X). If they have reached 
different cycles, say X reached A and Y reached B, then Y will typically stay 
in B for a time larger than e tyT+5 ^ (for 5 small enough), and if X reached B 
before Y left it the two processes will typically meet in a time shorter than 
gir- 5 )/ 5 T ne key question is then that of the distribution of the hitting time 
of B for the process X that reached A (and a) on the short time scale e^ v ~ s ^ . 
The exponential law provides the answer. Putting everything together we get 
that for any 7 > 1 there is a positive (3q such that, for all (3 larger than j3 , 



max. 

x,y 



lPx, v (t c >^E a [r B ]) < \ (7.74) 
With (17301) this gives 

Ti<-fE a [T B ] (7.75) 
or, for any 7 > 1 and (3 large enough, 

Ti<"fE a [ n ] (7.76) 
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Since we also have 



we conclude 



E "W~k~H^xj- Tl (7J7) 



Ti~E a [n} (7.78) 



7.4 A final remark 



All this gives the tools to deal with relaxation to the global equilibrium /i. But 
this is not conclusive as far as the question raised at the end of Section [5] is 
concerned: what about the relaxation to the restricted ensemble, or to a local 
equilibrium? As far as I understand what has been done is the last decades in 
the study of metastability it seems to me that this is now a central and still 
unsolved question. One source of inspiration to deal with it could be found in 
Miclo's work l38l. 
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